Universal Access To All Knowledge
Home Donate | Store | Blog | FAQ | Jobs | Volunteer Positions | Contact | Bios | Forums | Projects | Terms, Privacy, & Copyright
Search: Advanced Search
Anonymous User (login or join us)
Upload

Reply to this post | Go Back
View Post [edit]

Poster: James983 Date: Jul 17, 2012 1:29pm
Forum: web Subject: Question for Jeff regarding contradictory statements on web crawling policy

The Wayback Machine FAQ says: "We will only capture the one page you enter, and it does not get added to any sort of list to be crawled regularly, so doing this will not ensure that your site will be captured regularly or with any completeness."

Whereas you say: "click the "Latest" button to add your site to the database and capture the live shot. The live shot will only be captured the one time. After that the next capture will be whenever it is crawled again."

So my question is, does the page URL get added to the database to be crawled or not?

Reply to this post
Reply [edit]

Poster: Administrator, Curator, or StaffJeff Kaplan Date: Jul 17, 2012 2:36pm
Forum: web Subject: Re: Question for Jeff regarding contradictory statements on web crawling policy

my bad. clicking "latest" will only capture that instance of that url. it does not as i suggested add it to a database for future crawling.

Terms of Use (10 Mar 2001)